Northport is a community in the Canadian province of Nova Scotia, located on the Northumberland Strait in Cumberland County .